When AI Takes Control Of Your Computer

Download this post...

Google is reportedly gearing up to introduce its interpretation of the large action model concept known as “Project Jarvis,” with a preview potentially arriving as soon as December, according to The Information. This project aims to streamline various tasks for users, including research gathering, product purchasing, and flight booking.

Sources familiar with the initiative indicate that Jarvis will operate through a future version of Google’s Gemini technology and is specifically optimized for use with the Chrome web browser.

The primary focus of Project Jarvis is to help users automate everyday web-based tasks. The tool is designed to take and interpret screenshots, allowing it to interact with web pages by clicking buttons or entering text on behalf of users. While in its current state, Jarvis reportedly takes a few seconds to execute each action, the goal is to enhance user efficiency by handling routine online activities more seamlessly.

This move aligns with a broader trend among major AI companies working on similar capabilities. For instance, Microsoft is developing Copilot Vision, which will facilitate interactions with web pages.

Apple is also expected to introduce features that allow its AI to understand on-screen content and operate across multiple applications. Additionally, Anthropic has launched a beta update for Claude, which aims to assist users in managing their computers, while OpenAI is rumored to be working on a comparable solution.

Despite the anticipation surrounding Jarvis, The Information warns that the timeline for Google’s preview in December may be subject to change. The company is considering a limited release to select testers to help identify and resolve any issues before a broader launch. This approach reflects Google’s intention to refine the tool through user feedback, ensuring it meets expectations upon its official introduction.

Read full story here…